SUBMITTED TO IEEE TRANSACTIONS ON INFORMATION THEORY, APRIL 2013 



Short Message Noisy Network Coding 

Jie Hou and Gerhard Kramer 

Institute for Communications Engineering 

Technische Universitat Miinchen, 80290 Munich, Germany 

Email: {jie.hou, gerhard.kramer}@tum.de 



m 

o 

< 

in 



C/2 



> 

o 



X 



Abstract — Short message noisy network coding (SNNC) differs 
from noisy network coding (NNC) in tliat one transmits many 
short messages in blocks rather than using one long message with 
repetitive encoding. Several properties of SNNC are developed. 
First, SNNC achieves the same rates as NNC for memoryless 
networks where each node transmits a multicast message. Second, 
SNNC permits backward decoding which helps to understand 
the achievable rate region. The analysis shows that each decoder 
may ignore certain nodes rather than decoding the messages of 
all nodes. Third, SNNC enables early decoding if the channel 
quality happens to be good. This leads to mixed strategies that 
unify the advantages of decode-forward (DF) and NNC. 

Index Terms — Capacity, network coding, relaying, quantiza- 
tion. 



I. Introduction 

Noisy Network Coding (NNC) HI extends network coding 
from noiseless to noisy networks. For example, NNC includes 
the results of |l2l-||5l as special cases. NNC uses three tech- 
niques from JS]: 

• Sources use repetitive encoding with long messages. 

• Relays quantize without hashing (or binning) which we 
refer to as quantize-forward (QF). 

• Destinations decode messages and quantization bits 
jointly rather than sequentially. 

One important drawback of long messages is that they inhibit 
decode-forward (DF) at relays even if the channel conditions 
are good ||6l|. For example, if one relay is close to the source 
and has a strong source-relay link, then the natural operation is 
DF which removes the noise at the relay. But this is generally 
not possible with a long message because of its high rate. 

Fortunately, long messages are not needed and a variant 
called short message NNC (SNNC) works just as well iH- 
E). SNNC has: 

• Sources transmit independent short messages in blocks 
(the same method was used ||9] Appendix D]). 

• Relays perform QF but perhaps with hashing (or binning) 
which is called compress-forward (CF). Note that QF is 
a special case of CF with binning rate zero. 

• Destinations use backward decoding (or joint decoding 
or any other type of decoding). 

SNNC with CF and step-by-step decoding was studied for 
relay networks in ||9] Sec. V] and ifTOl Sec. 3.3.3]. We remark 
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that the name of the relaying operation (DF, CF, QF, NNC, 
SNNC) should not depend on which decoder is used at the 
destination but is a generic name for the processing at the 
relay. Indeed, the choice of decoder turns out to be important 
for NNC ID, la and SNNC M- 

The main goals of this work are to simplify and extend 
the unicast results of JU and IS), Q by showing that SNNC 
achieves the same rates as NNC for memoryless networks 
with multiple multicast sessions. We find that SNNC has 
constraints that do not appear for NNC, but we show that these 
constraints are redundant. Furthermore, we show that these 
"extra" constraints give insight about the optimal decoding 
procedure. For example, for a fixed random coding distribution 
there exists at each destination node an optimal decodable set 
||8l of messages that should be decoded to achieve the best 
rates. 

This paper is organized as follows. In Section HI] we state 
the problem. In Section |llll we show that SNNC achieves the 
same rates as NNC for memoryless networks with multiple 
multicast sessions. In Section |IV] we discuss the results and 
relate them to other work. In Section |V] we present coding 
schemes for mixed strategies that allow relay nodes to switch 
between DF and QF depending on the channel conditions. 
Results on Gaussian networks are discussed in Section [Vl] 
Finally, Section IVIII concludes the paper 

II. Preliminaries 

Random variables are written with upper case letters and 
their realizations with the corresponding lower case letters. 
Bold letters refer to random vectors and their realizations. A 
random variable X has distribution Px- We write probabilities 
with subscripts Px{x) but we drop the subscripts if the 
arguments of the distributions are lower case versions of the 
random variables. For example, we write P{x) ~ Px{x). Cal- 
ligraphic letters denote sets, e.g., we write /C = {1, 2, . . . , K}. 
The size of a set S is denoted as |5| and the complement set 
of S is denoted as S'^. Subscripts on a symbol denote the 
symbol's source and the position of the symbol in a sequence. 
For instance, Xki denotes the i-th output of the fc-th encoder 
Superscripts denote finite-length sequences of symbols, e.g., 
^k ~ {^ki, ■ ■ ■ , Xkn)- Set subscripts denote vectors of letters, 
e.g., Xs ^ [Xk : k e S]. We use T^{Px) to denote the 
set of letter-typical sequences of length n with respect to the 
probability distribution Px and the non-negative number e ifTTl 
Ch. 3], d. 

Consider the ii'-node memoryless network depicted in 
Fig. [T] where each node has one message only. This model 
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Fig. 1. A /^-node memoryless network. The network is a DiVIN if tlie 
alphabets of X^ and Yjj are discrete and finite for fe = 1, . . . , A". 



does not include broadcasting messages and was used in Hj 
and ini Ch. 15] . Node k, k £ JC, has a message Wk 
destined for nodes in the set V^, "D^ C K, \ {k}, while 
acting as a relay for messages of the other nodes. We write 
the set of nodes whose signals node k must decode correctly 
as Vk = {i G /C : k E Vi}. The messages are mutually 
statistically independent and Wk is uniformly distributed over 
the set {1, . . . , 2"^''}, where 2"^'= is taken to be a non- 
negative integer 

The channel is described by the conditional probabilities 



P(2;«|.T«) = P(2/i,...,yK|xi,...,XK) 



(1) 



where Xk and 3^^, k G /C, are the respective input and output 
alphabets, i.e., we have 



{xi,. 


.,xk) e Xix ■ 


■xXk 


(yi,. 


• ,2/if) € 3^1 X • 


■y<yK 



If all alphabets are discrete and finite sets, then the network 
is called a discrete memoryless network (DMN) lfT4l . ifTsl 
Ch.l8]. As usual, we develop our random coding for DMNs 
and later extend the results to Gaussian channels. Node k 
transmits Xki G Xk at time i and receives i/ki G J^fe. The 
channel is memoryless and time invariant in the sense that 

(2) 

for all i. 

We can represent the DMN as a directed graph Q = {/C, £}, 
where £ C /C x /C is a set of edges. Edges are denoted as 
{i,j) G £, i, j G /C, i ^ j. We label edge {i,j) with the 
non-negative real number 



ju,...,yKi\wi,. 


.,WK,X\,.. 


■.x'ji,y\ 


= PYK\xK{yu,- 


..,yKt\xu,. 


■■,XKi) 



c. 



max max I{Xi ]Yj\X^ 



K\i 



XK\i) 



(3) 



called the capacity of the link, where I{A\B\C = c) is the 
mutual information between the random variables A and B 
conditioned on the event C = c. Let Path(i j) be a path that 
starts from node i and ends at node j. Let ^[i.j) to be the set 
of such paths. We write {k,l) G Path(j jj if {k,t) lies on the 




Fig. 2. A line network with 4 nodes. Each node can communicate reliably 
with any other node as long as Cij > for all i,j. 



path Path(jj'). We may communicate reliably between nodes 
i and j if 



R. 



Path/, 



Q 



kl 



(4) 



is positive. We assume that Rij > for all nodes i with a 
message destined for node j. Observe that if Cij > for all 
i,j, then at most K —1 hops are needed for node i to reliably 
convey its message at rate 



min Ri 

jeK 



(5) 



by multihopping to all other nodes in the network. Hence, for 
a A'-node memoryless network at most K{K — 1) hops are 
needed for all nodes to "flood" their messages by multihopping 
through the network. 

Example 1: A line network with 4 nodes is depicted in 
Fig. |2] Node 1 has a message for node 4 and we assume 
that Ci2 > 0, C23 > and C34 > so that node 1 
can communicate reliably to node 4 by multihopping through 
nodes 2 and 3 with 3 hops. 

We define two types of functions for each node k: 
• n encoding functions fj^ ~ (/^i, . . . , fkn) that generate 
channel inputs based on the local message and past 
channel outputs 



One decoding function 

gk{Y^\Wk)^[w^''\ leVk] 

where W} is the estimate of Wj at node k. 



(6) 



(7) 



The average error probability for the network is defined as 



pin) ^ Pj. 



U Uw^^^^} 



fee/c 



e-D^ 



(8) 



A rate tuple {Ri, . . . , Rk) is achievable for the DMN if for 
any e > 0, there is a sufficiently large integer n and some 
functions {/^ }f=i and {gk}k=i such that P^'^ < e. The 
capacity region is the closure of the set of achievable rate 
tuples. For each node k we define 



ICk = {k}UVkUTk, Tk<^Vl\{k} 



(9) 



where Tk has the nodes whose messages node k is not 
interested in but whose symbol sequences are included in 
the typicality test in order to remove interference. We further 
define, for any S C C C K,, the quantities 

I§{k) = I{Xs;Ys^Yk\Xs^) - IiYs;Ys\XcYs^Yk) (10) 



I§{k\T)=I{Xs;Ys^Yk\Xs^T) 



IiYs;Ys\XcYs^YkT) 
(11) 
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Muldhop K messages to K — 1 nodes 
in K ■ {K — 1) ■ n' channel uses 



TABLE 1 
SNNC FOR ONE MULTICAST SESSION PER NODE. 



where S'^ in ( fTOl ) and ( fTTT ) is the complement of S in C. We 
write Rs = Y^kes^k- 

III. Main Result AND Proof 

The following theorem is the main result of this paper 
Theorem 1: For a /v-node memory less network with one 
multicast session per node, SNNC achieves the same rate 
tuples (i?i, . . . , Rk) as NNC, namely the rate tuples satisfying 



0<Rs < Ig'i^lT) 



(12) 



for all k <E K., all subsets S C ICk with k e S"" and SOVk ^ 
0, where S'^ is the complement of S in ICk, and for joint 
distributions that factor as 



Pit) 



K 



\[P{xk\t)P{yk\vk.Xk,t) 



Lfc=l 



P(y-|x«) 



(13) 



Remark 1: The set ICk (see (|9]l) represents the set of nodes 
whose messages are known or decoded at node k. In other 
words, from node fc's perspective the network has nodes ICk 
only. 

Example 2: If V ~ Vi = ■ ■ ■ = Vk, then the bound (fTSl i 
is taken for all k E K, and all subsets S C ICk with k E S'^ 
and 5 n 2? 7^ 0, where S'^ is the complement of S in ICk- 

Example 3: Consider K, ~ {1,2,3,4} and suppose node 1 
has a message destined for node 3, and node 2 has a message 
destined for node 4. We then have V^ = {1} and I?4 = {2}. 
If nodes 3 and 4 choose Tij = {2} and 71 = {0} respectively, 
then we have IC3 = {1,2,3} and IC4 = {2,4}. In this case 
the rate bounds (fT2l i are: 
Node 3: 

Ri < I{Xi;Y2Y3Y3\X2X3T) (14) 

i?i + i?2 < I{XiX2; YsYslXsT) 

-I{nY2;YiY2\X,X2X3%Y3T) (15) 

Node 4: 

R2 < I{X2; YiY^lXiT) - I{Y2-Y2\X2XiYiYiT) (16) 

To prove Theorem [T] we choose ICk = IC for all k for 
simplicity. We later discuss the case where these sets are 
different. For clarity, we set the time-sharing random variable 
T to be a constant. Table H] shows the SNNC encoding process. 
We redefine Rk to be the rate of the short messages in relation 
to the (redefined) block length n. In other words, the message 
Wfe , fc G /C, of nBRk bits is split into B equally sized blocks. 



Wki, • ■ • , WkB, each of nRk bits. Communication takes place 
over B + K ■ {K — \) blocks and the true rate of Wk will be 

nBRk 



R. 



k,Xnxe. ' 



1) 



(17) 



nB + [K ■ {K 

where n' is defined in ( [20l ) below. 

Random Code: Fix a distribution Hfc^i P{^k)P{yk\yk, Xk)- 
For each block j = l,...,B and node k £ IC, 
generate 2^'^^^''+^*'> codewords Xkj{wkj,lk{j-i)), 
Wkj ~ 1,...,2"«S/ 

to ]Xl^lPXk{X(kj)^ 

each Wkj and Ik(j-i), generate 2"^'" reconstructions 

ykj{lkj\wkj,lkij-i)), Ikj = l,...,2"^\ according to 
ITLlPY,\xJy{k])^\^ikj)^iwkJ,lkU-l)))■ This defines the 
codebooks 

Ck] = {^kj{wkj,lk{j-l)),ykjilkj\wkj,lk{j-l)), 



kU-i) = l,...,2"^^ according 
where ^^o = 1 by convention. For 

2"flfc 



Wkj 

hj = 



1,- 



inflfc 



, lku~i) 



■^nRk 



1,...,2"^''=} 



(18) 



for j = 1, . . . ,B and k E K,. 

The codebooks used in the last K{K—1) blocks with j > B 
are different. The blocks 

j = B + {k-l)-{K-l) + l,...,B + k-{K-l) (19) 

are dedicated to flood IkB through the network, and for all 
nodes k G IC we generate 2" ^* independent and identically 
distributed (i.i.d.) codewords x.^^{lkB), hs = 1, 
according to lYi=i Px~^ ( 



^{k]\i) 



We choose 
nRk 



-tn'Rk 



max - 
k min Ri,i, 



(20) 



keic 



^kk 



that is independent of k and B. The overall rate of user k is 
thus given by ( fTTl ) which approaches Rk as i? — > 00. 

Encoding: Each node k upon receiving ykj at the end of 
block j, j < B, tries to find an index Ikj such that the 
following event occurs: 

Eo(kj){h]) ■{yk]{lkj\wkj,lk{j-i)), y^kj{wkj,lk{j-i)), Ykj) 
e^"(^nx.n) (21) 

If there is no such index Ikj, set Ikj = 1. If there is more than 
one, choose one. Each node k transmits Xkj{wkj,lk(j-i)) in 
block j = 1,...,B. 

In the 7^—1 blocks ( fT9] l, node k conveys IkB reliably to 
all other nodes by multihopping Xkj{lkB) through the network 
with blocks of length n' . 
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A. Backward Decoding 

Let ei > e. At the end of block B + K ■ {K - I) every 
node k G K, has reUably recovered 1^ — {hs, ■ ■ ■ , Irb) via 

the multihopping of the last K(K — 1) blocks. 

(k) 
For block j = B, . . . , 1, node k tries to find tuples w^- = 



r,?/'') 7?,(''h and T^'^) - r/e^) 

(Wij ,...,Wj^.) ana i^-^^^ - (.'i(j_i),- 
the following event occurs; 



, It^i ■ i>) such that 






Si(,,)(wf,n!^,,l 



( 






,ik) f{k) 



(fc) ,-(fe) 



yij(^ij|wy%^i(j_i)),---,yifi(^xj|u'KJ''k:(j-i))'yfcj 



&T, 






(22) 



where 1^ = {lij, . . . , Ikj) has already been reliably recovered 
from the previous block j + 1. 

Error Probability: Let 1 ~ (1, . . . , 1) and assume without 
loss of generality that w^ = 1 and \j-i = 1. In each block j, 
the error events at node k are: 



El 



(kj)n 
(fcj)i 



Hkj)2 

The error event E^j 
satisfies 



n^,, i?;i(fe,)(^fc,) (23) 

^i(fc,) (1,1,1) (24) 

^{^^,dj-i)^{i,i) ^i(fej)(wj,lj-i,l) (25) 
^i=oE(kj)i 3.1 node /c in block j thus 



can be made 



i=0 



where we have used the union bound. Pr[i!^(i.j)o 
small with large n, as long as (see 1721 ) 



Rk>I{Yk:Yk\Xk)+S,{n) (27) 

where (5c(n) ^- as n ^ 0. Similarly, Pr[_E(fcj-)i] can be 
made small with large n. 

To bound Pr[£^(j,j')2], for each Wj and lj_i we define 

M{vfj) = {ielC: w,j 7^ 1} (28) 

Q(l,-i) = {* e /C : /,(,_i) ^ 1} (29) 

5(w,,l,_i) = X(w,) U Q(l,_i) (30) 

and write 5 = 5(wj, Ij-i). The important observations are: 

• (X^jYg) is independent of (X^c , Y51 , Y^.j ) in the 
random coding experiment; 

• The (Xi,li), i E S, are mutually independent. 
For k G S'^ and (wj, Ij-i) 7^ (1, 1), we thus have 

Pr[i?i(,,.)(w„l,_i,l,)]<2-"(^--^-(")) 

where J^i ("■) — > as n ^- and 



(31) 



/.s = 



E^(^*^*) 



.i£S 



H{Xs^Ys^Yk 






.ies 



H{Ys\X^Ys.Yk). (32) 



By the union bound, we have 

HEik,)2]< E Pi-[^i(fcj)K-, 1,^1,1)] 

(Wj,lj-l)#(l,l) 
(Wj,lj-l)#(l,l) 



(c) 



E E n (2"''' - 1) 11(2"''' - 1) 

S:keS'^MCS,QCS \ieM ieQ J 

Sji$ MUQ=S 

. 2-"(-fs-'5ti(")) 



^ V^ V^ 2"^-M2"^®2 



-n(/s-i5£j(n)) 



S:fce5'A4C5,SC5 
57^0 MUQ=S 



(d) 



< y^ 3|S|2"(-Rs+J^S-(-f5-i5.i("))) 
S:keS^ 

E2 

5#0 



n|fls-(/5--R5-^^^^-<5.i(n)) 



(33) 



where 

(a) follows from OTT l 

(b) follows by collecting the (w_,, lj_i) 7^ (1, 1) into classes 
where S = 5(wj, lj_i) 

(c) follows because there are 



■Q(2"«. _i)]J(2"«' -1) 



(34) 



different (wj,lj_i) 7^ (1,1) that result in the same A4 
and Q such that MCS, QCS and S = MUQ 
(d) is because for every node i e 5, we must have one of the 
following three cases occur: 

1) ie M andi 1^ Q 

2) i<^ M andie Q 

3) i e M and i e Q 

so there are Sl*^' different ways of choosing Ai and Q. 
Since we require R^ > I(Yk; Yk\Xk) + S^{n), we have 



Is-Rs<Is-J2 Hy^■,Y^\Xi) ~ 5,ir 



ies 



^4{k)-d,{n). 



(35) 



Combining (|26] |, (IZTT i. ( |33] | and ( l35T l we find that we can make 

Pr[£'/.j] — )• as ri ^ 00 if 



< i?5 < /s (fc) 



(36) 



for all subsets S C K, such that k E S'^ and 5 7^ 0. Of course, 
if Ig{k) < 0, then we require that R^ = 0. 

We can split the bounds in (|36] | into two classes: 



Class 1 : 5 n Pfe 7^ (37) 

Class 2 : 5 n Pfe = or equivalently S C Vl (38) 
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NNC requires only the Class 1 bounds. SNNC requires both 
the Class 1 and Class 2 bounds to guarantee reliable decoding 
of the quantization indices lj_i for each backward decoding 
step. Of course, if aU Class 2 bounds are satisfied, then SNNC 
achieves the same rates as NNC. In this case the decoder 
recovers the signals from the nodes in V^, and thereby removes 
interference from these nodes. 

Now suppose that an S in Class 2 has Rg > I§{k). We 
use the argument presented in I?]: for any J' satisfying S C 
J die such that J nVk ^ fb and k e J" we have 



R 



j\s 



<l'^{k)-Rs 



^<I§{k)~I§{k) 
(fc) 



(c) 



(d) 



(e) 



(/) 



I{Xj- Yj.Yk\Xj.) - I{Yj-Yj\XKYjcYk) 

- I{Xs;Ys^Yk\Xs^) + I{Ys;Ys\XK,Ys^Yk) 

I{Xj-Yj.Yk\Xj.)-I{Xs;Ys^Yk\Xs^) 

- I{Yj\s\YsYj\s\XKYj^Yk) 

- I{Ys;YsYj\s\XKYs^Yk) + I{Ys\Ys\XK.Ys^Yk) 

I{Xj;Yj.Yk\Xjc) - I{Xs;Ys^Yk\Xs^) 

- I{Yj\s;YsYj\s\XKYjcYk) 

IiXj\s;YjcYk\Xjc)+I{Xs;Yj.Yk\Xsc) 

- I{Xs;Ys^Yk\Xs^) - I{Yj\s;Yj\s\XKYj^Yk) 

I{Xj.s;Yj.Yk\Xj.) - I{Xs;Yj.s\Xs^Yj.Yk) 



(9) 



(h) 



- I{Yj\s;Yj\s\XKYj.Yk) 

I{Xj\s;Yj^Yk\Xj.) - IiYj\s;XsYj\s\Xs^Yj.Yk 
I{Xj\s; Yj.YklXj.) - IiYj\s;Yj\s\Xs'Yj.Yk) 



W r-IC\S 



(k) 



(39) 



where 

(a) follows because R^ > Igik) by assumption 

(b) follows from the definition (fTOl i 

(c) follows from the chain rule for mutual information 

(d) follows from the Markov chain 

Xs^Yj\sYs'Yk - ^5^5 - Ys (40) 

(e)-(h) follow from the chain rule for mutual information and 
the Markov chain 

X^^jXsYsYj.Yk - Yj\sXj\s - Yj\s (41) 

(i) follows from the definition ( fTOl i. 
The rates satisfying ( [39] l are the NNC rates for the nodes in 
IC\S while treating the signals from the nodes in S as noise. 
This shows that if any of the constraints in Class 2 is violated 
for NNC or SNNC, then the destination node should treat 
the signals from the corresponding nodes as noise rather than 
decoding them. 

Now repeat the above argument for the nodes in IC\S, until 
we reach a set ICk C /C, for which 



for all subsets S C ICk such that k G S'^ and 5 7^ 0. By the 
union bound, the error probability for all destinations tends to 
zero as 77, ^- 00 if the rate tuple (_Ri, . . . , Rk)^ satisfies (|42] | 
for all subsets S C ICk with k E S'^ and S n T>k 7^ 0, where 
S'^ is the complement of S in ICk, and for joint distributions 
that factor as 



K 



Y[P{xk)Piyk\yk,Xk) 



.fe=i 



P(y^|x^) 



(43) 



Adding a time-sharing random variable T completes the proof 
of Theorem 1 for ICk = IC for all k. The proof with general 
ICk follows by having each node k treat the signals of nodes 
in /C \ ICk as noise. 



IV. Discussion 

A. Backward Decoding and Sliding Window Decoding 

SNNC with backward decoding was first studied in |8l for 
relay networks with one source-destination pair (unicast) and 
multiple relays. For these networks, [8] showed that NNC and 
SNNC achieve the same rates. Further, for a fixed random 
coding distribution there is a subset of the relay nodes whose 
messages should be decoded to achieve the best NNC and 
SNNC rates. Several other interesting properties of the coding 
scheme were derived. 

The paper 16] showed that SNNC with sliding window 
decoding achieves the NNC rates for (single) relay channels 
and pointed out SNNC's advantage of enabling DF In Q, a 
simplified proof of the equivalence of the NNC and SNNC 
rates for the unicast networks considered in ||8] was provided. 
We used this proof in ( [39] l to extend the results of ['HI to general 
memoryless networks with multiple multicast sessions with 
either backward decoding or joint decoding. We also extend 
the concept of optimal decodable set to multi-source networks, 
see Sec. |IV-F| below. 



B. Multihopping 

We compare how the approaches of Theorem [T] and lH] 
Theorem 2.5] reliably convey the last quantization indices \b- 
Theorem [T] uses multihopping while Theorem 2.5 in ||8l uses a 
QF-style method with AI extra blocks after block B with the 
same block length n. In these A/ blocks every node transmits 
as before except that the messages are set to a default value. 
Both B and M must go to infinity to reliably decode 1^ ||8] 
Sec. IV. A, Equ. (34)]. The true rate of node /c's message Wk 
is 



Ri 



iBRk 



B 



k.tvue 



nB + nM B + M 



Rk 



(44) 



0<Rs <Isik) 



(42) 



and we choose B ^ M so that i?'j. ^^^ —>■ Rk as B ^^ 00. We 
remark that multihopping may be a better choice for reliably 
communicating 1^, because the QF-style approach has a large 
decoding delay due to the large value of AI. 
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(a) Both nodes 1 and 2 
are sources and relays 




(b) Node 2 acts as a re- 
lay for node 1 



Point 2 




Fig. 3. Examples of a thi'ee-node network with different rate pairs. 



Fig. 4. Illustration of the achievable rates for the network of Fig. |3(b) 



C. Choice of Typicality Test 

Theorem 1 has a subtle addition to fj] and difference to [[T] 
Theorem 2] and 1115; Theorem 18.5], namely that in (l42t each 
k E K, may have a different set ICk of nodes satisfying all 
Class 2 constraints whose messages and quantization indices 
are included in the typicality test. But we can achieve the rates 
in ( |42] | at node k with SNNC by using backward decoding 
and treating the signals from the nodes in /C \ /Cfc as noise. 
Hence we may ignore the Class 2 constraints in (l38T l when 
determining the best SNNC rates. 

The following example suggests that it may not be sur- 
prising that the SNNC and NNC rate regions are the same. 
Consider the network in Fig. |3] where /C = {1, 2, 3}. Suppose 
both nodes 1 and 2 act as sources as well as relays for each 
other in transmitting information to node 3 (see Fig. |3(a)| l. 
Referring to Theorem [T] the SNNC and NNC bounds are (see 
Fig. 0: 

Ri < I{Xv,Y2Y3\X2) - /(yi;yi 1X1X2^2^3) (45) 

i?2 < I{X2; YiYslXi) - I{Y2;Y2\XiX2YiY3) (46) 

Ri+R2< /(X1X2; Y3) - I{YiY2; YiY2\XiX2Y3) (47) 

However, suppose now that node 2 has no message (R2 = 0) 
and acts as a relay node only (see Fig. |3(b)| i. Then NNC does 
not have the bound (|46]l while SNNC has the bound (|46ll with 
R2 = and Yi = 0. We ask whether ^ reduces the SNNC 
rate. This is equivalent to asking whether SNNC achieves point 
1 in Fig. |4] It would be strange if there was a discontinuity in 
the achievable rate region at R2 = 0. 

D. Joint Decoding 

It turns out that SNNC with joint decoding achieves the 
same rates as in Theorem [T] Recently, the authors of IIT6I 
showed that SNNC with joint decoding fails to achieve the 
NNC rates for a specific choice of SNNC protocol. How- 
ever, by multihopping the last quantization indices and then 
performing joint decoding with the messages and remaining 
quantization bits, SNNC with joint decoding performs as well 
as SNNC with backward decoding, and as well as NNC. This 
makes sense, since joint decoding should perform at least as 
well as backward decoding. Details are given in Appendix lAl 

E. Decoding Subsets of Messages 

From Theorem [U we know that if node k decodes messages 
from nodes in ICk and some of the Class 2 constraints in 



are violated, then we should treat the signals from the 
corresponding nodes as noise. In this way, we eventually wind 
up with some ICk ~ {k} LiVk^Tk,Tk ^ 2?^ \ {k}, where all 
Class 2 constraints are satisfied, i.e., we have 



0<Rs < Is {k\T), for all 5 C Tfc, 5 ^ 



(48) 



and we achieve as good or better rates. In this sense, the sets 
JCk are important even for NNC. These sets seem difficult to 
find in large networks because many constraints need to be 
checked. However, provided that the sets JCk are known, we 
have the following lemma. 

Lemma 1: For the A'-node DMN, the rate tuples 
(i?i, . . . , Rk) are achievable if 

Rs<l'l'{k\T) 

for all k e /C^U subsets S cK.k with k e 5'= and SnT>k ^ 0, 
ICk = {fc} U Pfe U Tk, Tk C VI \ {fc}, where Tk satisfies ^ 
and for any joint distribution that factors as (ITjt . 

Proof: The proof follows by including the messages from 
nodes in ICk satisfying ( |48] | in the typicality test at every 
destination fc in Theorem [T] ■ 

F. Optimal Decodable Sets 

SNNC was studied for relay networks in |l8l. For such net- 
works there is one message at node 1 that is destined for node 
K. We thus have Vr = {1} and V%\{K} = {2, . . . , K- 1}. 
The authors of fS) showed that for a given random coding 
distribution 

P{t)P{xi\t) Y[ Pixk\t)P{yk\yk,Xk,t) (49) 

there exists a unique largest optimal decodable set T* , 
T* C D^ \ {A"}, of the relay nodes that provides the same 
best achievable rates for both SNNC and NNC IS] Theorem 
2.8]. We now show that the concept of optimal decodable set 
extends naturally to multi-source networks. 

Lemma 2: For a A'-node memoryless network with a fixed 
random coding distribution 



K 



P{t)\[p{xk\t)P{yk\yk,xk,t) 



(50) 



fc=i 



there exists for each node fc a unique largest set 7^* among 
all subsets Tk Q 2?^, \ {fc} satisfying (|48l l. The messages of 
the nodes in 7^* should be included in the typicality test to 
provide the best achievable rates. 
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Proof: We prove Lemma|2]without a time-sharing random 
variable T. The proof with T is similar We show that 7^* is 
unique by showing that the union of any two sets T^ and 
T^ satisfying all constraints also satisfies all constraints and 
provides as good or better rates. Continuing taking the union, 
we eventually reach a unique largest set T^ that satisfies all 
constraints and gives the best rates. 

Partition the subsets Tk Q 2?^ \ {k} into two classes: 

Class 1: Rs < Ig'ik) for all S C Tt; 

Class 2: There exists one 5 C TL such that Rs > /^''(fc). 

We may ignore the Tk in Class 2 because the proof of 
Theorem [T] shows that we can treat the signals of nodes 
associated with violated constraints as noise and achieve as 
good or better rates. Hence, we focus on Tk in Class 1. 

Suppose T,} and T,^ are in Class 1 and let T^ ^T^UT,^. 
We define 



ICl = {k}UVkUT^' 
ICl = {k}UVkUT,' 
ICl = {k}UVkUTl 



(51) 
(52) 
(53) 



Further, for every 5 C /C|, define Si ~ S O ICj. and ^2 = 
SniJCl\ Si). We have Si C K-l, S2 C K-l, SiUS2=S and 
5i n ^2 = 0. We further have 

Rs — Rsi + ^52 

(b) P-l p2 

<is:ik)+is:{k) 



(c) 






ICl'KlXS^' 



< I{Xs,;Yj^s^sYk\Xji,s\s) ^(^5,;>5j^^i%\5,^fc) 
+ nXs.;%\sYk\X^.^^sJ-I{%.,:YsJX^.Y^.^^^Yk) 

< /(X5,;%,\5rfc|X^3\5) - IiYs,;YsAX^sY^s^^Yk) 
+ I{Xs.;%\sYk\X^.^^sJ~I{Ys,-,YsjX^^Y^.^^^Yk) 

(/) 



= HXs; Yj^s\sYk\Xj^s^^) IiYs;Ys\X^sY^,^^^Yk) 
'^llhk) 



(54) 



where 

(a) follows from the definition of Si and ^2 

(b) follows because both T/} and T^ are in Class 1 

(c) follows from the definition ( flOl i 

(d) follows because all Xk are independent and conditioning 
does not increase entropy 

(e) follows because conditioning does not increase entropy 
and by the Markov chains 

^K|\52^/C|\52^fe ^ XS2^52 - XS2 (55) 

^ic3\5^%\5rfe- 15.^5. -Xs. (56) 

(f) follows from the chain rule for mutual information and 
the Markov chains (ISSl l and (|56] | 

(g) follows from the definition ( fTOl i. 



The bound ( l54l i shows that 7J? is also in Class 1. Moreover, 
by ( l54l i if k includes the messages of nodes in ICf. in the 
typicality test, then the rates are as good or better than those 
achieved by including the messages of nodes in /C^ or K.^ in 
the typicality test. Taking the union of all 71- in Class 1, we 
obtain the unique largest set 7^* that gives the best achievable 
rates. ■ 

Remark 2: There are currently no efficient algorithms for 
finding an optimal decodable set. Such algorithms would be 
useful for applications with time-varying channels. 

V. SNNC WITH A DF OPTION 

One of the main advantages of SNNC is that the relays can 
switch between QF (or CF) and DF depending on the channel 
conditions. If the channel conditions happen to be good, then 
the natural choice is DF which removes the noise at the relays. 
This not possible with NNC due to the high rate of the long 
message. On the other hand, if a relay happens to experience 
a deep fade, then this relay should use QF (or CF). 

In the following, we show how mixed strategies called 
SNNC-DF work for the multiple-relay channel. These mixed 
strategies are similar to those in [9;; Theorem 4]. However, in 
||9l the relays use CF with a prescribed binning rate to enable 
step-by-step decoding (CF-S) instead of QF. In Section [Vl] 
we give numerical examples to show that SNNC-DF can 
outperform DF, CF-S and NNC. 

As in [[91, we partition the relays T = {2, . . . , A' — 1} into 
two sets 

Ti={k: 2<k< Ki} 
T2=T\Ti 

where 1 < A'l < A' — 1. The relays in 7i use DF while the 
relays in 72 use QF. Let 7r(-) be a permutation on {1, ... , K} 
with 7r(l) = 1 and tt{K) = K and let 7r(j : k) ~ {7r(j),7r(j + 
l),...,7r(fc)}, 1 < j < k < K. Define T{^) = U{k),k e 
T}, i = 1,2. We have the following theorem. 

Theorem 2: SNNC-DF achieves the rates satisfying 

-RsNNC-DF < max max min 

x(-) Ki 
l<,^^^^_l^(-^''i^--'')'^^i''+^)\^''i''+^--Ki)) ' 

I{XiXr,,„^Xs;Ys^YK\Xs^) - I{Ys;Ys\XiXrYs^YK)] 

(57) 

for all S C 72(7r)- where S'^ is the complement of S in 72(7r), 
and where the joint distribution factors as 

Pi^i^T,,J-[ n PMP{yk\yk.Xk) 
keT2(„) 

■ P{y2,---,yK\xi,...,XK-i)- (58) 

Remark 3: As usual, we may add a time-sharing random 
variable to improve rates. 

Proof Sketch: For a given permutation 7r() and ATi, the 
first mutual information term in (l57i describes the DF bounds 
|9, Theorem 1] (see also iflTl Theorem 3.1]). The second 
mutual information term in (ISTt describes the SNNC bounds. 
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ii + 1 


B + 2---B + 4 


^1 


Xll(lUl,l) 


Xi2(W2,Wi} 


xib(wb,wb-i} 


Xl(B+l)(l,«'i3) 




X2 


X2l(l) 


X22(«'l) 


X2s(l«(B_i)) 


X2(S+l)("'s) 


Multihop Ib+1 


X-i 


X3l(l) 


X32(h) 


X3b{Ib-i) 


X3(B+l)('s) 


to node 4 in 3n' 


Y3 


ysi^ili) 


y32(^2|U) 


y3s(^sKs-i) 


y3{fl + l)('s+l|^B) 


channel uses 



TABLE 11 

Coding scheme for the two-relay channel with block Markov coding forxij() andx2j(). 



Using a similar analysis as for Theorem [T] and by treating 
(XiXj-^i^^^) as the "new" source signal at the destination, we 
have the SNNC bounds 

^SNNC-DF < I{^1^Ti(^)Xs]Ys'Yk\Xs'^) 

~ I{Ys:Ys\XiXrYs^YK) (59) 

< IiXs;YscYK\X,Xr,,^^Xsc) 

- IiYs;Ys\XiXrYs^YK) (60) 

for all S C T2{tt}- 

The same argument used to prove Theorem [T] shows that if 
any of the constraints (|60] | is violated, then we get rate bounds 
that can be achieved with SNNC-DF by treating the signals 
from the corresponding relay nodes as noise. Thus we may 
ignore the constraints (l60t . ■ 

Example 4: Consider A' = 4 and Ki = 2. There are two 
possible permutations 7ri(l : 4) = {1, 2, 3, 4} and 7r2(l : 4) = 
{1,3,2,4}. For 7ri(l : 4) = {1, 2, 3,4}, Theorem|2]states that 
SNNC-DF achieves any rate up to 



Rs 



NNC-DF 



{l{Xi;Y2\X2), IiXiX2;%Y^\X3), 



(61) 



(62) 



/(XiXaXg;^) - I{Y3;Y3\XiX2X3Yi)} 
where the joint distribution factors as 

P{xi,x2)P{x3)P{y3\y3, X3) ■ P{y2, ys, y4\xi,X2, X3) 

The corresponding coding scheme is given in Table HI] 

If relay node 2 uses DF while relay node 3 uses CF-S, then 
by II9] Theorem 4] with U2 = 0, any rate up to 

i?[CF-S]-DF < min {l{Xi;Y2\X2),I{XiX2;Y3Y4X3)} (63) 

can be achieved, subject to 

IiY3;Y3\X3Yi)<I{X3;Yi) (64) 



and the joint distribution factors as (|62] |. It turns out that 
-R[CF-S]-DF in (I63]l-(l64ll is the same as i?sNNC-DF ( l6T] i. since 
NNC and SNNC do not improve the CF-S rate for one relay 
|]6l. But i?sNNC-DF is better than i?[CF-si-DF in general. 

A. SNNC-DF without Block Markov Coding 

The coding for Theorem |2] uses block Markov coding 
(BMC) which may not be practical for rapidly changing 
channels. For example, if K = A and node 2 cannot decode 
due to a deep fade while node 3 can decode because of good 
channel conditions, source node 1 would need to change its 
codebook and encoder to cooperate with relay node 3 by 
selecting a joint distribution Px^Xs rather than PxiX2- 



We can circumvent this issue by not using BMC, i.e., all 
nodes use the same encoder for all channel states. We show in 
Appendix |B] that, without BMC, backward decoding achieves 
rates satisfying 

^SNNC-DF <min|/(Xi;y2|-'^2), 

IiXi;Yi) + I{X2;Y3Yi\XiX3), 

/(X1X2X3; n) - I{Y3; 131^1^2^3^)} (65) 

while joint decoding recovers rates up to (1611 but the joint 
distributions now factors as 



P{xi)P{x2)P{x3)P{y3\y3, X3)P{y2, ys, y4\xi,X2,X3) 



(66) 



rather than in (I62t where Xi and X2 may be dependent. The 
rate ( |65] | is in general lower than the rate (1611 under (|66] . This 
demonstrates that joint decoding can improve performance 
over backward decoding when BMC is not used. 

Remark 4: How to perform DF for multiple sources is not 
obvious. Consider again the three node network in Fig. |3] but 
now every node wishes to send a message to the other two 
nodes. How should one set up cooperation if all nodes may use 
DF? Such questions are worth addressing, since their answers 
will give insight on how to incorporate mixed strategies to 
boost system performance. 

VI. Gaussian Networks 

We next consider additive white Gaussian noise (AWGN) 
networks. We use X ^ CAf{iJ,, cr^) to denote a circularly 
symmetric complex Gaussian random variable X with mean 
p. and variance a^ . Let Z^ = Z1Z2 ■ ■ ■ Zk be a noise string 
whose symbols are i.i.d. and Zk ^ CN{Q, 1) for all k. The 
channel output at node k is 



n 



K 

^GjkXj 



Zk 



(67) 



where the channel gain is 

Gjk 



Hju 



(68) 



and djk is the distance between nodes j and fc, a is a path-loss 
exponent and Hjk is a complex fading random variable. 

We consider two kinds of fading: 

• No fading: Hjk is a constant and known at all nodes. We 

set Hjk = 1 for all j, fc £ /C. 
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Fig. 5. A relay cliannel. 

• Rayleigh fading: we assume Hjk ^ CAf{0, 1). We further 
assume that a destination node k knows Gjk for all j, k E 
K, and a relay node k knows Gjk for all j E IC and knows 
the statistics of all other Gji,j, I G /C. We focus on slow 
fading, i.e., all Gjk remain unchanged once chosen. 

We avoid issues of power control by imposing a per-symbol 
power constraint E[|Xfcp] < Pk- We choose the inputs to be 
Gaussian, i.e., Xk ^ CAf{0,Pk), k e JC. 

In the following we give numerical examples for four 
different channels 

• the relay channel; 

• the two-relay channel; 

• the multiple access relay channel (MARC); 

• the two-way relay channel (TWRC). 

We evaluate the performance for no fading in terms of achiev- 
able rates (in bits per channel use) and for Rayleigh fading in 
terms of outage probability ifTSl for a target rate i?tar- 
Relay node k chooses 



Yk = Yk + Zk 



(69) 



where Zk ^ CA/'(0,(t^). For the no fading case, relay node 
k numerically calculates the optimal ct^ for CF-S and SNNC, 
and the optimal binning rate Rk{hin) for CF-S, in order to 
maximize the rates. For DF, the source and relay nodes 
numerically calculate the power allocation for superposition 
coding that maximizes the rates. For the Rayleigh fading case, 
relay node k knows only the Gjk, j G /C, but it can calculate 
the optimal af and Rk[bm) based on the statistics of Gji, for all 
j,l £ K, so as to minimize the outage probability. For DF, the 
fraction of power that the source and relay nodes allocate for 
cooperation is calculated numerically based on the statistics 
of Gjk, for all j, fc e /C, to minimize the outage probability. 
Details of the derivations are given in Appendix |C] 



A. Relay Channels 

The Gaussian relay channel (Fig. |5]l has 



Y2 — G12X1 + Z2 

Y3 ~ G13X1 + G23X2 + Zy, 



(70) 
(71) 



and source node 1 has a message destined for node 3. 

1) No Fading: Fig. |5] depicts the geometry and Fig. |6] 
depicts the achievable rates as a function of di2 for Pi = 
4, P2 = 2 and a = 3. DF achieves rates close to capacity 
when the relay is close to the source while CF-S dominates as 
the relay moves towards the destination. For the relay channel, 
CF-S performs as well as SNNC (NNC). SNNC-DF unifies the 
advantages of both SNNC and DF and achieves the best rates 
for all relay positions. 
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Fig. 6. Achievable rates R (in bits per channel use) for a relay channel with 
no fading. 
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Fig. 7. Outage probabilities for a relay channel with Rayleigh fading. 



2) Slow Rayleigh fading: Fig. |7] depicts the outage prob- 
abilities with i?tar = 2, Pi = 2P,P2 = P, di2 = 0.3, 
d23 = 0.7, (ii3 = 1 and a = 3. Over the entire power range 
CF-S gives the worst outage probability. This is because CF- 
S requires a reliable relay-destination link so that both the 
bin and quantization indices can be recovered. Both DF and 
SNNC improve on CF-S. DF performs better at low power 
while SNNC is better at high power SNNC-DF has the relay 
decode if possible and perform QF otherwise, and gains 1 dB 
over SNNC and DF. 
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rfi3 = 0.8 



Fig. 8. A two-relay channel. 



d.i = 0.2 




Fig. 9. Achievable rates R (in bits per channel use) for a TRC with no 
fading. 
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Fig. 10. Outage probabilities for a TRC with Rayleigh fading. 
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B. Two-Relay Channels 

The Gaussian two-relay channel (Fig. |8]i has 

I2 = G12X1 + G32X3 + Z2 (72) 

Y3 ~ G13X1 + G23X2 + Z3 (73) 

I4 = G14X1 + G24X2 + G34X3 + Z4 (74) 

where the relay nodes 2 and 3 help node 1 transmit a message 
to node 4. 

1) No Fading: Fig. |8] depicts the geometry and Fig. |9] 
depicts the achievable rates for Pi = P2 = B^ = P and a = 3. 
The CF-S rates are the lowest over the entire power range. 
As expected, SNNC improves on CF-S. DF performs better 
than SNNC at low power but worse at high power SNNC- 
DF achieves the best rates and exhibits reasonable rate and 
power gains over SNNC and DF for P — — 5 dB to 5 dB. The 
gains are because in this power range SNNC-DF has relay 2 
performing DF and relay 3 performing QF 

2) Slow Rayleigh Fading: Fig. [TO] depicts the outage prob- 
abilities with i?tai = 2, Pi = P2 = .P3 = P, the geometry 
of Fig. [8] and a ~ 3. CF-S gives the worst performance 
over the entire power range. This is because CF-S requires 
a reliable relay-destination link for both relays so that the bin 
and quantization indices for both relays can be decoded. DF 



Fig. 11. A MARC. 



provides better outage probabilities than CF-S but is worse 
than NNC or SNNC, since it requires reliable decoding at 
both relays. SNNC-DF has the two relays decode if possible 
and perform QF otherwise and gains about 1 dB over NNC 
(SNNC). In general, we expect larger gains of SNNC-DF over 
NNC for networks with more relays. 



C. Multiple Access Relay Channels 
The Gaussian MARC (Fig. [Uj has 



Y3 — G13X1 + G23X2 + Z3 

Y4 = G14X1 + G2iX2 + G34X3 



(75) 
(76) 



and nodes 1 and 2 have messages destined for node 4. 

1) No Fading: Fig. [TT] depicts the geometry and Fig. [12] 
depicts the achievable rate regions for Pi = P2 = ^3 = P, 
P = 15 dB and a = 3. The SNNC rate region includes the 
CF-S rate region. Through time-sharing, the SNNC-DF region 
is the convex hull of the union of DF and SNNC regions. 
SNNC-DF again improves on NNC (or SNNC) and DF 
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Fig. 12. Achievable rate regions for a MARC with no fading. 
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Fig. 13. Outage probabilities for a MARC with Rayleigh fading. 

2) Slow Rayleigh Fading: Fig. [T3] depicts the outage proba- 
bilities with i?tarl = i?tar2 = 1, Pi = ^2 = ^3 = P, C?13 = 0.3, 

^23 = 0.4, di4 = ^24 = 1, d^4 — 0.6 and a ^ 3. CF-S has the 
worst outage probabiUty because it requires a rehable relay- 
destination link to decode the bin and quantization indices. 
DF has better outage probability than CF-S, while NNC (or 
SNNC) improves on DF over the entire power range. SNNC- 
DF has the relay perform DF or QF depending on channel 
quality and gains 1 dB at low power and 0.5 dB at high power 
over SNNC. 

Remark 5: The gain of SNNC-DF over SNNC is not very 
large at high power This is because the MARC has one relay 
only. For networks with more relays we expect larger gains 



di3 = 0.25 




Fig. 14. A TWRC. 

from SNNC-DF 

D. Two-Way Relay Channels 

The Gaussian TWRC (Fig. [Hi has 

Yi = G21X2 + G31X3 + Zi 

Y2 = Gi2^1 + G32X3 + Z2 

I3 = G13X1 + G23X2 + Z3 



(77) 
(78) 
(79) 



where nodes 1 and 2 exchange messages with the help of relay 
node 3. 

1) No Fading: Fig. [14] depicts the geometry and Fig. [15] 
depicts the achievable sum rates for Pi = 5P, P2 = 2P, P3 = 
P and a = 3. DF gives the best rates at low power while 
SNNC provides better rates at high power The CF-S rates 
are slightly lower than the SNNC rates over the entire power 
range. SNNC-DF combines the advantages of SNNC and DF 
and achieves the best rates throughout. 

2) Slow Rayleigh Fading: Fig. [16] depicts the outage prob- 
abilities with Ptarl = 2, Ptar2 = 1, Pi = 5P, P2 = 2P, 

P3 = P, the geometry of Fig. [14] and a — 3. CF-S has 
the worst outage probability since it requires that both relay- 
destination links (3 — 1 and 3 — 2) are reliable so that the bin 
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Fig. 16. Outage probabilities for a TWRC with Rayleigh fading. 



and quantization indices can be recovered at both destinations 
1 and 2. DF is better than CF-S, while NNC (or SNNC) 
improves on DF. SNNC-DF lets the relay use DF or QF 
depending on the channel conditions and gains over about 2 
dB at low power and 1 dB at high over NNC (or SNNC). 

VII. Concluding Remarks 

SNNC with joint or backward decoding was shown to 
achieve the same rates as NNC for multicasting multiple 
messages in memoryless networks. Although SNNC has extra 
constraints on the rates, these constraints give insight on 
the best decoding procedure. SNNC enables early decoding 
at nodes, and this enables the use of SNNC-DF. Numerical 
examples demonstrate that SNNC-DF shows reasonable gains 
as compared to DF, CF-S and NNC in terms of rates and 
outage probabilities. 



Appendix A 
SNNC WITH JOINT Decoding 

After block B + K ■ {K — 1) every node k E JC can reliably 
recover 1^ = {hs, ■ ■ ■ , Ikb) via the multihopping of the last 
K{K - 1) blocks. 

Let ei > e. Node k tries to find a (W]^ , . . . , w^ ) and 



i(fc) 



TW) 



(Ij^ ,...,1^') such that the event (|22] | occurs for all j = 
1, . . . , B, where Is is already known. The difference between 
joint decoding and backward decoding is that the typicality 
test is performed jointly over all blocks (see (I80t-d82t below) 
while it is performed in only one block in (l2Ji-(l25t. 

Error Probability: Let 1 = (1,...,1). Assume without loss 
of generality that Wj = 1 and 1^ — 1 for j = 1, . . . ,B. For 
any 5 C /C, define 



W(5)j = [w,j : 
The error events at decoder k are: 

EkO ■■ ^j = l<^lkj K{kj)ilk3) 



i€S] 



E, 



k2 



J(w5 ^l,w5j UiB n^-^i E^kj){^j,\j^i,\j) 



The error event Ek ~ Uf^QEki at node k thus satisfies 

Pv[Ek] < Pv[E^o] + Pr[Eki] + Pr[Ek2] 



(80) 
(81) 
(82) 



(83) 



where we have used the union bound. 

Pr[i?feo] can be made small with large n as long as (see 
(Ell)) 

Rk>IiYk;Yk\Xk) + 6,in). 



(84) 



Also, we have 



Pr[i?fei]=Pr[(nf=ii?i(,,) (1,1,1))^] 



Pr[uf^iSJ(,. (1,1,1)] 



<J2mei 

(a) 

< B-S,,{n) 



{kj) ^ 

(.,)(!, 1,1)] 



(85) 



where (a) follows because Pr[i?wj, s (1, 1, 1)] < 5^^ (n), which 
goes to zero as n — > oo, for j = 1, . . . , B IIT2I . 
To bound Pr[i?fe2], for each (wj, lj_i), we define 

5,(w,, lj_i) = {?: e /C : w,j ^ 1 or ;,(,_i) ^ 1} (86) 

and write Sj = Sj{wj, Ij-i). Observe that for j = 1, . . . ,B : 

. {Xs^,Ysj) is independent of (X^c , Y^. , Y^^ ) in the 

random coding experiment; 
• the {Xij,Yij), i E Sj, are mutually independent. 
We have (see (3T[ and (l32l)): 



Pr[i?i(,,)(w„l,_i,l,)]<P(fc,)(5,) 



where 



P{k3){S]) 



2-n(Is^-S,,(n)) jfc. -^ 



Otherwise 



(87) 



(88) 
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X3 
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^32{ll) 
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Y3 


ysiaili) 


y32('2Kl) 


y3s('sKs~i) 


yg 


(fl+i)('s+iKs) 


channel uses 



TABLE III 
Coding scheme for the two-relay channel without block Markov coding at the source. 



and Sei (n) — > as 71 — > oo. 
By the union bound, we have 



Pr[Ek2] < E E Pi-[nf=ii?i(fe,) (w, , 1,-1 , 1, 






IB-l 



(a) 



E Enp'-[^i(fe^)K-'i^-i'ij-)] 

lB-lj = l 






(b) 
< 



< 



id) 



il-S,,{n,B)) 



E np'"[^i(^j)K' 1,-1,1,)] 

B 

j=i 

E YlPmi^^ 

B 

n E pm(^^) 

j = l Wj,lj_i 

., = ( 

5:fce5'-- (Wj,lj_i)#(l,l): 
V 55^0 5j(Wj,lj-l)=<S 

-(l-<5,,(n,B)) 

1+ y^ 3l'S|2"(«s + fls)-(/s-<5.i(n))) 

-(l-<5,,(n,B)) (89) 



j=i 



\ 



/ 



< 



V 



/ 



where 

(a) follows because the codebooks are independent and the 
channel is memoryless 

(b) follows by adding (w^ = -1,'^^c ) '^o the sum 

(c) follows from dSTl i and because (see (|85] l) 

B 

Pr[nf=i£;i(fc,)(l, 1, 1)] = n Pr[i^i(fc,)(l, 1, 1)] 

J=l 

= l-Pr[(njLii?i(fc,)(l,l,l)r] 



>1-(5,,KB) 



(90) 



(d) follows because P(j.j)(5j) depends only on Sj which in 
turn depends only on (wj,lj_i) 

(e) follows from 



(f) follows from ( l33T l. 
Performing the same steps as in ( |35] l and 

i?5 < /f (fc) 



we require 
(91) 



for all subsets S C K, such that k e 5"^ and 5 7^ 0. We can 
again split the bounds in ( |9T] l into two classes: 

Class 1 : 5 n 2?fc 7^ (92) 

Class 2 : 5 n Pfc = or equivalently 5 C P^. (93) 

and show that the constraints in (|93] l at node k are redundant 
with the same argument used for backward decoding. By the 
union bound, the error probability for all destinations tends to 
zero as n — !> 00 if the rate tuple (_Ri, . . . , Rk) satisfies (l42b 
for all subsets 5 C /C such that k E S'^ and 5 7^ 0, and for 
any joint distribution that factors as (|43] i. 

Appendix B 

Coding Scheme for the Two-Relay Channel 

WITHOUT Block Markov Coding 

We present a coding scheme without block Markov coding 
at the source for the two-relay channel. The destination per- 
forms either backward decoding or joint decoding. We show 
that joint decoding can achieve better rates than backward 
decoding. 

Table |III] shows the encoding procedure. The message w 
of nBR bits is split into B equally sized blocks wi, . . . , wb 
each of nR bits and is transmitted over B + 4 blocks. 

Random Code: Fix a distribution 

p{xi)p{x2)p{x3)p{y3\y3,X3). For each j = 1,...,B + 1, 
generate 2"-'^ codewords xij{w) and X2j(ti'), w = 1, . . . , 2"^, 
by using IV^=lPx^{xlj^) and U"=iPx2ix2jt), 
respectively. Further generate 2"^ codewords X3j(?j„i), 
Ij-i = 1,...,2"^, using lYLiPxA^Sji)- For each Ij^i, 
generate 2"^ reconstructions y3j(Zj|/j_i), Ij = 1,...,2"^, 

using nr=l Pn\Xs(y33^^33^i^3-i))- 

For block B + 2 to B + 4, generate 2" ^ codewords as in 
Theorem [T] where (see (l20t ) 



nR 
R34 



(94) 



Encoding: Node 3 upon receiving y^j at the end of block 
j, tries to find an index Ij such that 



(y3,(^,|;,-i),x3,(/,-i),y3,) e T^iPy^^^^y) 



(95) 



where /q = 1 by convention. If there is no such index Ij, set 
/, = 1. If there is more than one, choose one. 



SUBMITTED TO IEEE TRANSACTIONS ON INFORMATION THEORY, APRIL 2013 



14 



In each block j = 1, . . . , B + 1, node 1 transmits xij{wj), 
node 2 transmits X2j{wj^i) assuming correct decoding in 
block j — 1, and node 3 transmits X3j(Zj_i), where wq — 

WB + l = 1- 

In block j = B+2, . . . , i?+4, node 3 conveys Ib+i reliably 
to node 4 by sending X3j(/b) by using multihopping at rate 
R through the network. 

Decoding at Relays: 

1) Node 2. For j = I, . . . ,B, node 2 tries to find a Wj that 
satisfies 

(xi (u,,),X2K-i),y2,) e T" (Pxix.yj • (96) 

Node 2 can reliably decode Wj if 

i?</(Xi;r2|^2)-5eN (97) 

where 5e{n) —s- as n — )• od (see ITSl ). 

2) Node 3. For j = 1, . . . ,B + 1, node 3 successfully finds 
an Ij such that ( |95] l is satisfied if 

i?>/(y3;>3|^3) + '5.W (98) 

where ^^(n) -> as n — )• oo (see llT2l ). 

A. Backward Decoding at Node 4 

At the end of block B + 4, node 4 can reliably recover 
Ib+1, via the multihopping of the last 3 blocks. Let ei > e. 
For j ^ B, . . . ,1, node 4 declares {wj, Ij) — {wj, Ij), if there 
is a unique pair {wj, Ij) satisfying the typicality checks in both 
blocks j + 1 and j: 





i = i 




i = 2 




j = 3 




i = 4 




i = 5 




i = 6 




j = 7 


Xlj("'j) 


X 




X 




/ 




/ 




X 




X 




/ 


X2jK-i) 


/ 




X 




X 




/ 




/ 




X 




X 


X3j(/j_l) 


//x 




//x 




//x 




//x 




//x 




//x 




//x 



'5ii/'5i2 S31/S32 S21/S22 3^1/3^2 S11/S12 S31/S32 521/52: 
X : decoding failure 
/: successful decoding 

Fig. 17. An example of {Si, . . . ,5b+i)poss with B = 6. 



Combining ^, dTOlT l and dToa . SNNC-DF with backward 
decoding but without block Markov coding achieves rates 
satisfying 

^SNNC-DF < min|/(Xi;y2|-'^2), 

I{Xi;Yi) + IiX2;%Yi\XiX3), 
IiXiX2X3;Yi) - IiY3;Y3\XiX2X3Y^)y (105) 

B. Joint Decoding at Node 4 

Node 4 tries to find a w^ = {11)1,11)2, ■ ■ ■ ,wb) and l^ = 
{li, . . . , Ib) such that the following event occurs: 



^Xl(j+l)(Wj + l),X2(j + i)(Wj),X3(i+l)(Zi), 



El(A3){Wj,Wj-l,lj-l,lj) ■■ [yiljiWj),X2jiu)j^l),X3jilj~l), 

ys, Mj-i), y4,) e t- {Px,x2x,%y,) (106) 

for all J = 1, . . . , i? + 1, where wq = w's+i = 1 and Ib+i is 
already known. 

Error Probability: Let 1 = (1,...,1). Assume without loss 
of generality that w^ = 1 and Z^+^ = 1. The error events are 
as follows: 



and 



(xy(^,),y4,)er,';(Pxin 



(99) 



(100) 



E41: (nfJii£;i(4,)(i,i,i,i))' 



(107) 



£'42 : Ui„B^i U;b n^-Ji Emj){wj,Wj-i,lj,lj-i) (108) 



The error event E4 = Uf^iE^i satisfies 

Pr[Ei] < Pr[E4i] + Pr[^42] 



(109) 



where Wj+i and Zj+i have aheady been reliably decoded from 
the previous block j + I. 

Similar analysis as in Theorem [T] shows that node 4 can 
reliably recover {wj,lj) if 

R<I{Xr,Yi)+IiX2;%Yi\XiX3) (101) 

R < /(X1X2X3; Yi) - 7(^3; r3 1X1X2X3^4) (102) 

< /(X3; ^41^1^2) - I{%; Y3\XiX2X3Yi) (103) 



where we have used the union bound. Performing the same 
steps as in dSSl l. we have 



Pt[Eai] < {B + I) ■ S,,{n) 



(110) 



If the constraint ( |103l l is violated, then the rate bound (|102| l 
becomes 



(111) 



ii'</(XiX2;r4) 



(104) 



which is a stronger bound than (llOll l and can be achieved 
with SNNC-DF by treating Xs as noise. Thus, we may ignore 
(|103l l. Continuing this way, node 4 successively decodes all 
messages Wj, j — 1, . . . ,B. 



which goes to zero as n — > 00. 

To bound Pr[i!^42], for every {wj,Wj-i,lj-i), j = 
l,...,i3 + l, we define Sj{wj,Wj-i,lj-i) C {1,2,3} that 
can take on one of the 8 values 

f5i*i = {l}, 51*2 = 11,3} 

52*1 ={2}, 52*2=12,3} 

53*1 ={1,2}, 53*2 = {1,2,3} 

[ 54*1 = {0}, 5^2 = {3} 

where S*^^, m = 1, . . . , 4, m = 1,2, indicates which of the 
messages Wj, Wj-i and Ij^i are incorrectly decoded (1 refers 
to Wj, 2 refers to Wj^i and 3 refers to Ij-i). We write Sj = 
Sj{wj,Wj^i,lj^i). For example, in Fig. [17] in block j = 1 
the message Wj is decoded in error while Wj^i is decoded 
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correctly. If /j_i is decoded correctly we consider Sj — S^i 
while if /j_i is decoded incorrectly we consider Sj = S*2- 
Observe that (X5 . , Y5 . ) is independent of (X^c , Yg^ , Y4J ) 
in the random coding experiment. We have (see (l3ll l and (l32T l): 



and 



PT[Ei^4j}{Wj,Wj^l,lj,lj^l)] < P(4i)(5j) 



where 



P{ij)i^j) 



2-n(/s^-5,Jn)) ifSj-^ 



1 



Otherwise 



(112) 



(113) 



where Is is defined in 
5ei (n) goes to zero as n 



with A' = 4 and y2 = and 
00. By the union bound, we have 



Pr[K 



■42 



Pr[^U„B_^i UiB nf+^^ £;i(4j)(u;j,u;j_i,/j,?j_i) 



(a) 



B+l 



lU-B^l l" 3 = 1 

(b) -B+l 



(114) 



where 

(a) follows because the codebooks are independent and the 
channel is memoryless 

(b) follows from ( fTT2l i 

(c) follows from ( |113t . 

Observe that for any w^ 7^ 1 and l^, due to the encoding 
(Fig. [TtI i. only certain sequences {Si . . .Sb+i) can occur, 
namely those for which 

. 5|^ or 5|^ follow 5i*„ 
. 5i*^ or 5|^ follow 52*„ 
. S^^ or 53*^ follow 53*„ 

• Sl^ or 5|^ follow 5|„ 

• the total number of S^i and 5j*2 is the same as the total 
number of ^21 and ^22 

with u, w = 1, 2. Denote these sequences as {Si . . . Sb+i)poss- 
The reason that only the {Si . . . Sb+i)poss sequences can occur 
is as follows. Suppose we find a wrong xij{wj) in block j, 
then X2(j+i)(i«j) in block j' + 1 is wrong as well. In this 
case, we could have 5|^ follow 5j*„. Suppose we find the right 
yiij{wj), then X2(j+i) {wj) will also be right so we could have 
^4^, follow S2u- For example, a {Si . . . Sb+i)po!,s sequence 
could be 



l'-'41'-'42 • ■ •'-'41^'-'lll'-'31'-'32 • ■ •'-'3lJ'-'21 ' ' ' V'-'42'-'41 • ■ •'-'42J 
• • ■ '->12 '>'-'32'-'31 ■ • • '-'32 -''-'22 ■ ■ ■ • 

For a given {Si... 5s+i)poss, let n„iu be the number of S^.^, 
TO = 1, . . . , 4, u = 1, 2. We have 



4 2 

EE 

m— 1 u—1 



rimu = S + 1 
?^ll +ni2 = 7121 +»^22 



(115) 
(116) 



-B + l 

E ^^3 ^ niils-^ + ni2lsi^ + "21/511 + "22/SJ2 

i=l:S,#0 

+ »^31/S3*i + "-32/53*2 + "42/54*2 

= eii(/5*^ + /s-J + ei2(/5*i + ^52*2) + e2i(/5r2 + ^52*1) 
+ e22(/5i*2 + ^•52*2) + '^3l/5|i + "32/53*2 + "42/5I2 (117) 

where 

' /5^=/(^i;^3i"4 1x2^3) 

/5i*2 = /(XlX3;r4|^2) +/(r3;XiX2y4|^3) 
/5|i=^(^2;r3r4|^1^3) 

/5,*, -/(^2^3;i4|^i) + /(i^3;^i^2n|^3) (US) 
/s3*i=/(^i^2;r3r4|X3) 

/S3*, = /(X1X2X3; Yi) + I{%-XiX2Yi\Xi) 

. /5I2 =^(^3;n|^1^2)+/(F3;^1^2>4|^3) 

and 611,612,621,622 are non-negative integers that satisfy 
611 +ei2 = "11 

621 + 622 = "12 

611 +621 = "21 

612 + 622 = "22- (119) 

We remark that the choice of (en, ei2, 621, 622) is not unique. 
For example, if rin = 5, "12 = 10, "21 = 7 and 
"22 = 8 we have riu + ni2 = "21 + "22 = 15. We can 
have (611,612,621,622) = (2,3, 5,5) or (611,612,621,622) = 
(0, 5, 7, 3). Both choices satisfy ( |119t . Further, the number of 
{wjjj^lj^i) that result in the same {Sj,Sj+i) = (5J'„,52„), 
u,v = 1,2, is upper bounded by (see ( |34] l) 



2n(-R+(l{«=2} + l{i)=2})_R) 



(120) 



because the same Wj is involved in both Xij(wj) and 
'^2ij+i){wj) where !{•} is the indicator function. Similarly, 
the number of {wj, Ij-i) that result in the same Sj = 5|„ is 
upper bounded by 



2n{R+l{u=2}R) 



(121) 



Finally, the number of /j_i that result in the same Sj = 5^2 
is upper bounded by 



■ynR 



(122) 



Hence, the number of w^ 7^ 1 and l^ that result in the given 
{Si, . . . ,5s+i)poss is upper bounded by (see ( |117t ) 

2n((eil +612+621+622 +"31 +"32 )-R+(ei2 +£21 +2622 +"32 +"42 )-R) 
_ 2"(("ll+"12+"31+"32)-R+(6l2+621+2622+n32+"42)-R) ("123") 
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We can bound ([TT7J as follows 

^ (a) 

2^ Is, > eii/5Ji + ei2/5|, + 621/51, 

+ 622 (/5J2 + /5J2) + "31/5J1 + "32/5J2 + '^42/5_ 
= ("-31 + eil)/5|i + ("11 + "12 + "32 - eii)/^!, 
+ (n42+e22)/5|2 

= ("31 + eii)/5|^ +{z- "-31 - eii)Is'^ 

+ {7142 + €22)13^2 

where 

(a) follows because 



1st, + ^s^i ^ -^53*1 

1st, + -^512 > /Sjs 

/^r, + isi, > isi^ 

Ist2 + Is^2 ^ -^5|2 + -f5j2 

(b) follows by defining 

z = nil + "12 + "31 + "32- 



Summing over error probabilities associated with all 
{Si, . . . ,5s+i)poss and combining (|97] i and ( |130t . joint de- 
coding achieves rates satisfying 

i?SNNC^DF < min {l{Xi;Y2\X2), I{XiX2;%Yi\X3), 

HX1X2X3; Yi) - I{%- ^31X1X2X3^4)} . (133) 

Appendix C 
Rates and Outage for Gaussian Networks 

(124) In the following, let C{x) = log2(l + x), x > 0. 



A. Relay Channels 

1) No Fading: The achievable rates R with DF and CF-S 
are given in |]9|- The SNNC and NNC rates are simply the 
CF-S rate. The SNNC-DF rate is the larger of the SNNC and 
DF rates. 

2) Slow Rayleigh Fading: Define the events 



(125) 



(126) 



DuF = {i?,ai- < C(|Gi2pPi(l - 1/31'))} 

23 I P2 



Combining ( 11231 ) and ( 11241 ). for a given {Si, . . . ,Sb+i)poss 
we have 



/?CF-S1 
/?CF-S2 = i R 



^'("")<^il + |Gi3PPi 



»Ef=+i^5,^0(^^.-^n(")) 



1 



|Gi2pPi 



'(^'")-^U2 ' ^2^l+\Gi,\2p,) 



EE 

{Si,...,Sb + i) — {Si,...,Sb + i)poss 

^ 2n{zR,+ {z-n3i-eii+n42+e22)R) 

^ 2-n(("3l+eii)/s.^+(z-n3l-eii)/s.^+(n42+e22)-fs|2-'5n("(-8))) 

^ 2"("42+e22)(-R--fs|2) . 2"'5.l("(-B)) 
< 2"[K^"™"{^'S|l'-^-53-2--R})+("42+e22)(ii-/siJ+'5.l("(S))] 

(127) 
which tends to zero as ri ^- 00 as long as 

i?<min {/53*,,/5-, -i?} (128) 



D 



SNNC 



(t;^ > 



IG23PP2 



(134) 



where |/3p is the fraction of power allocated by source 1 to 
sending new messages. The optimal (3, -R2(bin) and (t| are 
calculated numerically. 

The DF, CF-S, SNNC and SNNC-DF rates are 

-Rdf = Ol 
RcF-s — bi 

-RSNNC ~ Cl 



i?DF if Ddf occurs 
-RsNNC otherwise 



(135) 



R < Isi 



(129) 



Performing a Fourier-Motzkin elimination of R, the error 
probability tends to zero as n ^- cx) as long as 

i?<min {/(XiX2;f3i^4|X3), 

/(X1X2X3; Yi) - 7(^3; 131X1X2X3^1)} (130) 

< /(X3; ^1X1X2) - /(fg; 131X1X2X3^4). (131) 
If ( 1131b is violated, then the second term in (11301 ) gives 

ii'</(XiX2;r4) (132) 



where 

ai=min{G(|Gi2pPi(l-|/3n), 

G (|Gi3pPi + |G23|'P2 + 23fi{/3Gi3G;3}/P^) } 

G (^^ + |Gi3pPl) if i?CF-Sl n i?CF-S2 



if i^CF-Sl n £'cF-S2 

Otherwise 



which is a stronger bound than the first bound in (1130) and 
can be achieved with SNNC-DF by treating X3 as noise. Thus 
we may ignore the constraint (1131b . 



bi^{ G(|Gi3pPi) 

(^ f IGial^Pi 

^ \1 + \G23\^P2 

min {g (|Gi3pPi + IG23PP2) - G(^), 
ci = <; G(^i^ + |Gi3pPi)} ifi^sNNC (136) 

and 5R{.t} is the real part of x and x* is the complex conjugate 
of X. 

Remark 6: For SNNC, event P'snnc means that 

/(X2; FslXi) - 7(^2; 1^21X1X2^3) > (137) 
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and the destination can reliably recover X2 and I2 jointly 
which helps to decode Xi. Otherwise the destination should 
treat X2 as noise to get a better rate (see Theorem[T). Similarly, 
for CF-S the events I?cf-si and £'cf-S2 rnean that both X2 and 
Y2 can be decoded in a step-by -step fashion |fT9l . If -Dcf-si 
and -D^p 52 occur, then X2 can be recovered which removes 
interference at the receiver Otherwise the relay signal should 
be treated as noise. 

As recognized in |[20l . one drawback of DF is that if the 
source-relay link happens to be weak and the relay tries to 
decode, then the rate suffers. Hence the relay should decode 
only if the source-relay link is strong enough to support i?tar, 
i.e., if event Ddf occurs. Otherwise, the relay should perform 
CF-S or QF Different choices of relay operations depending 
on the channel conditions lead to the achievable rates with 
SNNC-DF 

The outage probabilities are as follows: 



Pr[i?DF < i?tar] 
= Pr[i?CF-S < R^4 



pout _ 
MDF - 
pout 
-fCF-S 

-FsNNC ^ Pr[-RsNNC < ^tar] 

-FsNNC-DF = Pr[-RSNNC-DF < -Rtai] 



(138) 



B. Two-Relay Channels 

1) No Fading: The achievable DF rates are ||9] Theorem 1] 

i?DF < max {i?DFl, ^DF2} (139) 

where 

-Rdfi = min {021,022,023} 
i?DF2 = min {621,^22, ^23} (140) 

with 

a2i = C(|/3i|2|Gi2|'Pi) 

022 = C ((1 - |/33n|Gi3pPi + |7inG23|'-P2 



+2K{/32Gi3(7iG23)*}/fV?^^ 

023 - G (|Gi4pPl + IG24PP2 + IG34PP3 

+ (25R{/32Gi4(7iG24)*} + 23?{/33Gi4(72G24)*}) /pT^ 
+25R{/33Gi4G^4}/P^ + 23f{{72G24G;4}\/iV^) 

&2i-G(i/?inGi3pPi) 

622 = G ((1 - |/33n|Gi2pPi + |7inG32|'P3 

+2JR{/32Gi2(7iG32)*}/p^) 

623 = G (|Gi4|'Pl + |G24|'P2 + |G34|'P3 



(23?{/?2Gi4(7iG34)*} + 23?{/33Gi4(72G34)*}) /P^ 



+2K{/32Gi4G^4}/pr?^ + 23?{7iG24G54}/f^ 

(141) 

where X]i=i lAP = 1 ^^'^ Tlii=i l7'P = 1 ^^'^ ^^^ optimal 
power allocation parameters are calculated numerically. 

The CF-S rates are (see ||9] Theorem 2] with Ui = 0, i = 
2,3) 



^CF^S < C21 



(142) 



subject to 
where 

C21=G 

d2 = C 

62 = G 
./2 = G 

52 = G 



52 < ^2, ^2 < 62, 12 < /2 



IG12PP1 , IG13PP1 



1 + <t2 1+6-2 

IG24I -P2 



+ IGmPPi 



■"141 -ri 
?34| P3 



n4\ -ri 



|G24p/^2 + |G34pP3 
I + IG14PP1 



IG12PP1 



'^l ^i(l + ^^ + |Gi4PPl 



/i2 - G I ^ 



IG13PP1 



IG12PP1 



J2-G 



a^, ai(l + ^^if^ + |Gi4PPi)^ 
2 + '^I 



■ 1 + O-^ + (7.2 



|Gi2pA(l + ai) + |Gi3pPi(l + ^i) \ ,.,,, 
a2ai(l + |Gi4PPi) )■ ^ '^ 

The optimal iTj and (t| are calculated numerically. 

Referring to Theorem [1] the achievable SNNC rates are 



PSNNC < min {621, J2I, J22,.723} 



(144) 



where 



j21=G(|Gi4pPl + |G24pP2 



IG13I Pj + IG23I P2 



PlP2(|Gi3nG24p + |Gi4|2|G23p) 



1 + -I 



23fi{Gi3G24G24G23}PlP2 ^ /-< Z' 1 



1 + al 



J22=G |Gi4rPl + |G34rP3 + 



2p , |Gl2|2Pi + |G32pP3 



i + al 



PlP3(|Gi2nG34p + |Gi4p|G32n 

(1 + ^i) 

2di{Gi2G34GUGl2} PiPA _c(l. 



(i + '^i) 

.723 = G (|Gi4|'Pl + |G24|'P2 + |G34|'P3) 



G 



1 + ct| + a| 



'21^3 



(145) 



where 62 1 is defined in ( 1143b . The optimal (t| and (t| are 
calculated numerically. 

If one relay uses DF and the other uses QF, rates satisfying 

Pdqf < max {Pdqfi, Pdqf2} (146) 

can be achieved, where 

Pdqfi =min {^21,^22,^23} 
Pdqf2 = min {/21, '22, '23} 
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with 



fc21=C 



\G,2?P,{l-W) 



1 + IG32PP3 

k22 - C f IGupPi + |G24|'P2 + 2^{eGuG1,^}^Pj\ 



|Gi3pPi + IG23PP2 + 23fi{0Gi3G53}/fV?^ 



1 



(l-|0|2)PiP2(|Gi3p|G24| 



|Gi4p|G23p) 



(1 - W)PlP2 ■ 2jR{Gi3G24Gt4G^3}) 

1 + ai 

^23 = G (|Gi4pPl + |G24|'P2 + |G34|'P3 

+23?{0Gi4G^4}/P^) - G f 4 

and 

|Gi3pPi(l-|0p) 



(147) 



421 



G 



IG23PP2 



^22 = G |Gi4pPi + IG34PP3 + 25R{0Gi4G;4}/fVR 



|Gi2pPi + IG32PP3 + 2^{eGi2Gh}VlW5 
l + a| 

(l-|e|2)PiP3(|Gi2p|G34| 



|Gi4p|G32p) 



(1 - |gp)PiP3 ■ 2jR{Gi2G34Gt4Gg2}) 

1 + ai 

^23 = G (|Gi4pPl + |G24|'P2 + |G34|'P3 

+23fi{0Gi4G54}/prP^) - G ("4 



(148) 



where < |6'p < 1 and the optimal 0, ctI and af for Pdqfi 
and i?DQF2 are calculated numerically. 

Referring to Theorem|2] SNNC-DF achieves rates satisfying 



^DFV — 



^SNNC-DF < max {i?DF, ^DQF, ^SNNc}- 

2} Slow Rayleigh Fading: Define the events 

i?tar < V21 
Rtm- < V22 

-DdFI = { i?tar < ^21} 

-DdF2 = { ^tar < ^21 } 

^2 (bin) < d2 
-DCF-Sl = { ^3(bin) < 62 



(149) 



-D, 



CF^S2 — 



= <: R 

R 



^2(bm) + ^3(bin) < /2 
^2 (bin) > 52 



3(bin) 
2 (bin) 



>/l2 

R 



3(bin) 



>i2 



^SNNCl — 

-C'SNNC2 = 
^SNNC3 — 



\r ,|2p , \G23rP2 > 1 
IG24I P2 + -T+af- - ai 

\r^ |2p I |G32|^P3 ^ 1 
IG34I ^3 + 1 + ^2 > -T 

|G24PP2 + |G34PP3> Jt 



(7? > 



'^3> 



1 + IG32 


?p. 


+ 


IG34I 


|^P3 


1 + IG23 


G24 

?P2 


2 p. 

+ 


I 

IG24I 


|2P2 



IG34PP3 



(150) 



where {V21, V22, ^23 } tak es on the value {021,022,023} or 
{&2i5 &22i ^23} (see (II4II 1) and the choice depends on the 
statistics of the fading coefficients such that the DF outage 
probability is minimized. 
The DF rates are 



PoF^min {V2i,V22,V23}- 
The CF-S rates are 

{C21 if P'cF-Sl n -DcF-S2 
C22 if i'cF-Sl n P'cF-S2 
C23 Otherwise 

where C21 is defined in ( I143l l and 

C22=G(|Gi4pPl) 



(151) 



(152) 



C23 = G 



IGmPPi 



(153) 



,1 + |G24PP2 + |G34PP3, 

Observe that if both i^cF-si and I?cf-S2 occur, then both the 
bin and quantization indices can be decoded. If only I?cf-si 
occurs, then only the bin index can be recovered. 
Referring to Theorem [T] the SNNC rates are 

min {C21,J21, J22,J23} ifi'sNNCi 

min {m2i, m22} if ^'snnci ^^ ^snnc2 

min {^21 , 922} if ^snnci ^^ ^snncs 

C23 otherwise 

(154) 

where 



^SNNC — 



77121 = G 



m22 = G 



<72i = G 



'?22 = G 



Pi(|Gi2p + (1 + ^|)|Gi4p) + P1P3IG14PIG32I 

|G32PP3 + (1 + <72)(1 + |G34PP3) 
PlP3(|Gi2p|G34p - 23f?{Gi2G34G*4G;2}) 
|G32PP3 + (l + a|)(l + |G34PP3) 
|G14PP1 + |G24PP2^ 



I + IG34PP3 



1 



IG32I Pz 



Ul '^i(l + |G34PP3). 

Pl(|Gi3p + (1 + ag)|Gi4p) + P1P2IG14PIG23P 

|G23PP2 + (1+<72)(1+|G24PP2) 
PlP2(|Gi3nG24p - 2JR{Gi3G24G^4GS3}) 
|G23PP2 + (l+a3')(l + |G24PP2) 
|Gi4pPi + |G34pP3^ 



I + IG24PP2 



-G\4. 



IG23I P2 



al a|(l + |G24PP2) 



(155) 



The event I?snnci means that both quantization indices can 
be recovered. The events -Dsnnc2 and I?snnc3 mean that only 
one of the two quantization indices can be decoded. 
The SNNC-DF rates are 

Pop if P'dfv 
Pdqfi if ^DFV ^ P'dfi 

PdQF2 if ^DFV ^ Dd¥2 

PsNNC otherwise 
where (see (|147| i and (|148l l) 

-Rdqfi =min {fc2i, ^22, ^23} 
-Rdqf2 = min {/21, '22, '23} • 



R 



SNNC-DF 



(156) 
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The outage probabilities are as in (1138) . 

C. Multiple Access Relay Channels 

1) No Fading: The DF rate region of the Gaussian MARC 
is the union of all pairs (i?i,i?2) satisfying 1211 Sec. 3] 

^1 < ^DFi = min {031,032} 
i?2 < ^DF2 = min {631, 632} 
Ri+ R2 < i?DF3 = min {€31,032} (157) 

where 

a3i=C(|Gi3|2pi(l-|/3|2)) 

a32=C(|Gi4pPl + |G'34|'P3 



+23fi{/3Gi4(0iG34)*}/fV?^ 

&31-C(|G23pP2(l-|7l')) 
632 = G(|G24pP2 + |G34pP3 



where (^31,631 and /31 are defined in ( 1160b and 



,931 = G (|Gi4pPl + |G34|'P3) - C ( 4 
h3l = C (IG24PP2 + |G34|'P3) - C ( 4 



131 = G (|Gi4pPl + |G24|'P2 + |G34|'P3) - G 



for some ct? > ,„ \'i„ . The SNNC-DF rate region is the 
union of the SNNC and DF rate regions. 
2) Slow Rayleigh Fading: Define the events 

^tarl < ^31 
^DF — { Rtm2 < ''31 

^tarl + -Rtar2 < C31 



"-341 ^3 



+ 23ft:{7G24(e2G34)*}/fVP^^ 

C31 - G (|Gi3pPi(l - W) + |G23pP2(l - 171')) 

C32 = G (|Gi4pPl + |G24|'P2 + IG34PP3 

+ 23fi{/3Gi4(0iG34)*}/P^ 
+25R{7G24(e2G34)*}/^^) (158) 

where < |^|M7p < 1 and Y.]=i \^i? = 1- The optimal 
power allocation parameters are calculated numerically. 

The achievable CF-S rate region is the union of all pairs 
{Ri,R2) satisfying EU Sec. 3] 



(159) 



-DCF-Sl — { P3(bin) < G 
-DCF-S2 = { -R3(bin) > C 



I+IG14PF1 + IG24PP2 



1 



|Gi3pPl + |G23pP2 



al a|(l + |Gi4PPi + |G24PP2) 

PlP2(|Gi3p|G24p + |Gi4p|G23n 
a|(l + |Gi4|2Pi + |G24|2P2) 
P1P2 • 2K{Gi3G24G*4G;3} 



a|(l + |Gi4PPl + |G24PP2) 



-DSNNC = S 0-3 > 



IG34PP3 



(162) 







Pi < ^31 






P2 < 631 






Pi + P2 < ./3I 


wher 

£^31 = 


■e 
.G 


'\Gi3?Pi , 1^ |2^^ 


631 = 


-C 


nG23pP2 , ,„ |2„\ 

1 j_;^2 +IG24I P2 

V l + cr3 / 



/31=C |Gi4pPl + |G24rP2 + 



|Gi3pPl + |G23pP2 

l + al 



The DF rate region of the Gaussian MARC is the union of 
all rate pairs (Pi,P2) satisfying ( 1157b . The CF-S rate region 
is the union of all (Pi , P2 ) satisfying 11211 

dzi if i'cF-si n P'cF-S2 
Pi < PCFI = { d32 if Z?CF-S1 n D'cp_s2 (163) 

(i33 otherwise 

631 if P'CF-Sl n DcF-S2 
P2 < PCF2 = { 632 if i?CF-Sl H D^^^^^ (164) 

633 otherwise 

/3I if P'CF-Sl ^ P'CF-S2 
Pi + P2 < PCF3 = { /32 if DcF-S^ n i?^p.s2 (165) 

/33 otherwise 



PlP2(|Gi3p|G24p + |Gi 



IG 



231 



25R{Gi3G24Gi4G23}) 



1 + al 



where 



(160) 



for some 

., ^ 1 + (|Gi3p + IGm^Pi + (IG23P + |G24nP2 

"' - IG34PP3 

PlP2(|Gi3p|G24p + |Gi4p|G23p - 2Sft{Gi3G24Gt4G^3}) 
IG34PP3 

Referring to Theorem [T] the SNNC rate region is the union 
of all pairs (Pi,P2) satisfying 

Pi < min {d3i,.93i} 
P2 < min {631, /131} 
Pi+P2<min {/3i,i3i} (161) 



rf32=G(|Gi4pPl) 

IGuPPi 



^33 



G 



.1 + IG34PP3 

e32 = G(|G24|'P2) 

_^f IG24PP2 

''' " ^ U + |G34P^3 
/32 = G(|Gi4|'Pl + |G24|'P2) 
IG14PP1 + IG24PP2 



/33 — G 



1 + IG34PP 



(166) 



If both P'cFSi and P'cf-S2 occur, then the relay bin and 
quantization indices can be decoded. If only P'cFSi occurs, 
then only the bin index can be recovered. 
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Referring to Theorem [T] the SNNC rate region is the union 
of all pairs {Ri,R2) satisfying 



The CF-S rate region 11221 Proposition 4] is the union of all 

(i?i , i?2 ) satisfying 



i?l < i?SNNCl 

i?2 < ^SNNC2 

i?l + i?2 < -RSNNCS 



min{d3i,53i} if Z^snnc 

d^s otherwise 

min{e3i,/i3i} if -Dsnnc 

633 Otherwise 

min{/3i,i3i} ifDsNNC 

/33 Otherwise. 



where 



(167) 



i?l < d4i 
i?2 < 641 






(172) 



The event Usnnc means that the destination should decode 
the relay signal to achieve better performance. 

The SNNC-DF rate region is the union of all (i?i,i?2) 
satisfying 

i?DFl if Dof 

^SNNCi otherwise 

i?DF2 if £'df 
^SNNC2 otherwise 



e4i = C(|G2ipP2 



Lf23| ^2 

TTaf 



for some 



^1 < -RsNNC-DFl = 

i?2 < -RsNNC-DF2 = 

Rl + R2 < -RsNNC-DF3 = 



where 



i?i 



DF3 



if Dr 



i?SNNC3 Otherwise. 



(168) 



If -Ddf occurs, then the relay should decode which will remove 
interference at the relay. Otherwise, the relay should perform 
QF to avoid unnecessarily lowering the rates. 

Let i?tar3 = ^tari + -Rtai-2- The outagc probabilities are: 

PSf = Pr[{i?DFl < -Rtarl} U {i^DFa < ^tar2} U {-RdF., < Rtars}] 
-PcF-S = Pr[{-RCFS1 < ^tarl} U {i?CF-S2 < -Rtai-2} 

U {i?CF-S < -Rtai-3}] 
^SNNC ^ Pr[{-RSNNC1 < ^tarl} U {i?SNNC2 < ^tai-2} 

U {i?SNNC3 < Ptar3}] 
^SNNC-DF ~ Pr[{^SNNC-DFl < ^tarl} U {-RsNNC-DF2 < Ptar2} 

U {i?SNNC-DF3 < i?tai-3}] (169) 

D. Two-Way Relay Channels 

1) No Fading: The DF rate region for the Gaussian TWRC 
is the union of all (i?i , i?2 ) satisfying 

Rl < Rdfi = min {041,042} 
i?2 < -Rdf2 = min {641, ^42} 

i?l + i?2 < i?DF3 = C41 (170) 

where 

a4i=C(|Gi3|'Pi(l-|/3|2)) 

042 = C (|Gi2pFl + |G32|'P3(1 - l^lH 

+25R{/3Gi2(0iG32)*}/P^) 

&41=G(|G23pP2(l-|7n) 

&42 = G (IG21PP2 + |G3lpP3(l - l^lH 



/4I- 
/42 = 
/43 — 



al > max {U1J42J43, /m} 



l + |Gi2pPl + |Gi3pPl 

IG32PP3 

|G2l|2P2 + l , |Gi3|2Pi(|G2l|2P2 + l) 



I 



44 



IG31PP3 |G3lPP3(|Gi2PPi + l) 

I + IG21PP2 + IG23PP2 

IG31PP3 
|Gi2pPi + l , |G23pP2(|Gi2pPi + l) 



IG32PP3 |G32PP3(|G2l|2P2 + l)' 

Referring to Theorem [T] the SNNC rate region is the union 
of all (RijRz) satisfying 

Pi < min {^41,, 941} 
P2 < min {641, /141} 

where 

1 



(173) 



ff41=G(|Gi2|'Pl + |G32|'P3 



G 



/l41=G(|G21pP2 + |G31pP3)-G 



1 



for some (t| > 0. The SNNC-DF rate region is the union of 
the DF and SNNC rate regions. 

2) Slow Rayleigh Fading: Define the events 

Ptaii < 041 

P'df = { Ptai-, < &41 



+25R{7G2i(02G3i)*}/fV^^ 
C41 = G (|Gi3pPi(l - l/^n + |G23pP2(l - ItH) (171) 



where < |/3|2, \-f\^ < 1 and J^Li 



1. The optimal 



power allocation parameters are calculated numerically. 



^CF-Sll = 
-DcF-S12 = 
-C'CF-S21 = 
£'CF-S22 = 
-DsNNCl = 
P'SNNC2 = 



tai'i T' Ptai-2 < C41 

IG31PP3 



P3(bin) < C 



I+IG21PP2 



IG23I P2 



P3(Mn)>G^^2 ' ai{l + \G2l\^P2) 



R 



3(bin; 



<G 



IG32PP3 

l + |Gi2|2Pi, 
1 , |Gi3pPl 



P3(bin)>G^^2 ' a|(l + |Gi2PPl) 



ai > 



al> 



1 



IG32PP3 

1 
IG31PP3 
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The DF region is the union of all {Ri,R2) satisfying dlTOI i. 
The CF-S region is the union of all (i?i, R2) satisfying 



Rl < i?CF-Sl 



i?2 < flcF-S2 




if -DcF-S21 n -DcF-S22 



ifD, 

Otherwise 



CF-S21 



no: 



CF-S22 



^ CF-S 12 



where 



C 



di2 
diz 

642 

643 = C 



if Z?CF-S11 n I?CF-S12 

ifi^CF-siini?^ 
Otherwise 



C(|Gi2pPi) 

\Gl2?Pl 



(174) 



(175) 



IG32PP3 



C(|G21pP2) 

\G21?P2 



1 + IG31PP3 



The optimal i?3(bin) and (t| are calculated numerically. 

Referring to Theorem [T] SNNC achieves all pairs (i?i, R2) 
satisfying 



Rl < PSNNCI 
R2 < -RSNNC2 



min {dii,gii} if Z^snnci 

d43 otherwise 

min {e4i,ft.4i} if Dsnnc2 

643 otherwise. 



(176) 
(177) 



The SNNC-DF rate region is the union of the (i?i,i?2) 
satisfying 



Rl < -Rsnnc-dfi 

i?2 < -RsNNC-DF2 



'dfi 


ifi^DF 


'snnci 


Otherwise 


'dF2 


ifi^DF 


'sNNC2 


otherwise 



(178) 
(179) 



The outage probabilities are: 

Pr[{i?DFl < i?tarl} U {Rdf, < i?tar2}] 
= Pr[{i?CF-Sl < i?mrl} U {i?CF-S2 < Ptar2}] 
^SNNC = Pr[{PsNNCl < Rtml} U {i?SNNC2 < -Rtar2}] 
^SNNC-DF = Pr[{^SNNC-DFl < Rtml} U {i?SNNC-DF2 < ^tar2}] 

(180) 



pout _ 
-'^DF 
pout 
^CF-S 
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